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field study, report tiia* will have meaning for them or possibly for 
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the workbook to write down their idea's an^ examii^e them befbre s - 
proceeding, in-order to assess their own development tdv carrying put 
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summfiry of ol)servational plans, (3) methods for making observational 
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suggestions fdr related reading to aid in -writing research reports. 
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A Personal Work-shop ' '\ ^ 



</ . John David Miller 



This workshop' focJses upon ways in whic^^ you, as a teacher, can gather 
helpful information regarding your activi ties with students, 
you will develop and use many ideas skilly, ^^^^^^^^^ Hoals of this 
workshop are idenified below, 

U i<6 a ^ULitt oi tkU mn}^hep you m^ZIi bd abl^ 
Xo gath^A, i^)/JJvLn zxLbtXnQ cM66^oom 6ztting^,' ' 
inf^onmoution that ^ manaqeab>^^-.^m--rtr^^ ancv^^ 
corrpliixAJ:^j and can be u^z{^td/to you In bdttz^ 
^ * imdoA^trndina youA mnk i^^iJh 6tadznt^. . 

2. Aa a ^t6uJU: oi tha> voonk6hop you wtZl^bd abtd 
to o^QanA.zz and oAtLcuJiatz youA ln{^onn\ation 
^ ^ In io^viting, In a (^Idtd 6'taci/j fizponX that latlt ^: 

kavz meaning f^a^ you on, po66tbly {^on, otKdn, 
Intzn^zbtdd pznjion^. ^ 
■. . > « 

This workshop is sel f-instructi Ve.'^' It is. supplemented by a program y 
(other book in this series) and a support system that includes / . 
instruction/ teaching experiences for practice, discussions, and 
individual conferenjpes , 

You will be asked at certain points in this workshop to write "down 
your ideas and examine them before proceeding. Experience indicates 
.Ifriat through this active involvement witH the text you will be better 
able to assess yoijr own 'development for carrying out educatibna-l 
research. ' ^ ' 4:* 



' '• - • :^ - . ■■ - ■ ' . ■ ^ • . . 

■ • ' ■ '■■» ■ " ■■ 
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^ INTRODUCTION , ' ' 

This workshop on ^^^a/ich and ci6 6 Q^6,ment represents an attempt to 
enable teachers to grasp these two words in broader contexts than thdft 
in which they are commonly used. As used throughout this book,* the words 
^re intended to convey the, notion of gathering information (in any fonm) 
that is helpful to ^e development of productive ta|iching-leaming &ctiv- 
ities. . An underlying assumption is that, as teachers, our effectiveness 
depends constantly on feedback from bur clientele, that is, our 'students. 
Feedback seems essential to any instructional enterprise that is to remain 
fresh and*viabl| in a rapidly evJlvinq society. 




Thus, this workshop is intended to enable teachers to gather ilnfor- 
mation that could have persuasive meaning for them in developing the.ir 
programs. Its purpose is not so much to provide a way of assigning value 
judgments (like good or bad) to existing programs. Rather it presents 
some"^ strategies fer-ga thering information useful ^in making further program 
.development a rational process. 



■^oilSTStent with -thls_Jdea^ author invi tes 'yo.ur feedback regardinq , 
the effectiveness of this workshop.' See appendix. , 't^^ ^ 



On 




^iefly, the workshop gbes spmethinq like this: You will be 
introduced to some issues in educational evaluation and assessment, 
invited to interact with some of the author's ideas, and then' 
invited to create some of your own. - ' 



\ . . - 

■ / ■ 

gathz/Ung pMdactivz In^onmation tlvU 6o^t, 
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What do I maJUiy voant to {^tnd out about my activiti^6 iA)ttk 
6tud^y^ and hovo do I^go about {^tnding it? ' ' 



Teacher-stud^n\ interactions most often take place in very complex 
settings , which can be portrayed "is collaoes of elements contained in 

the lo^os on which this program is based. The logos is represented 

^ ... 

below. - " ., 
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THE LEARNER 




a . 



Some of these elements are undoubtedly part of your teaching world 
Even thou^^ this collage ^ijs .complex, try writing down in priority three 
things Xaat you would honestly like\to find out- about your activities/ 
with stude'ntsT Try to choose one question from each of the three major 
themes of the program: instruction,' the' learner^ the discipline. 



1. 



\ 



c 



Tkink'oi thKdz. tiUngi you would like, to (^d^ut " 



.J 



It >cA oYiLi^ a guu6, but it'is HkeH that one or mqre of the following 



statements contain--td^,s parallel inq your own 



A' / 



:U I wtfuld 



e to -know how much 



math 
art . , 
science 
r^eading 

social studies 
(other subject) 



I've taug^ht my students, 
my students have learned. 



2. I would like to know if this 



questioning strate^^ 
homework - ^ S. 

laboratory experiment \ 
free time' . ^ 
textbook 
lecture 

movie * * 

ffeld trip • • 
comput-er garpe * 
guest 'lecturer ^ 
art workshop 
composition* 
V seguence of experiences 
phys i caK arrangem^t 
intra -class grouping. y 

' (other activity or strateay) 



is Ciseful forj^my teaqhing, 



1. 



3. I would like to better understan(!| i^y students 



intellectual development. . 

fami ly'^backgrqund . 

earlier school activities., 
^attitude toward school, 
ktlopted S€x roles.' 
•way of approaching problems^ 

capacity to handle proposit- 
ional logic- . _ 



^ (^0t4tfrr ' trrfonr^ i h n p e r t a f n i n q 

' . to my students; . 



ERIC 



Stc(^zmtnt6 dsyu.v(Ld c}vLQ.(^lij {^Kom ^fic^e vt/uee lonm much of^ 
thi bcUilA {^cf^ thd diAcu&6ioM contcUmd in thl6 u)ohk6hop. 
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jX ' ^ math ^ 



Interestingly, even though th^re are many ways of\ getting at thj^^ques- 
tion, teachers rely on one way predominantly: c . 

, We might. call this_way. ^ ^ . * 

* TEACH-THE-SUBJECT-THEN-GIVf-A-TEST 

' ■ or the TTSTG'AT strategy. ./ *• ■ \ 

The word tcJ consider^ this question is mac/i, its full s,ignifjcdnce 
"being the teacher's responsibility! Ask yourself, hdw much of the teaching 
or learning can I attribute to the dLUpoA^^on of'my own personal energy. ^ 
^ When ca^refuHy examined, this question is not .trivial, but neither U it 
impossible to approAch. ' . y 

Bat before going further, think' of s.ohie reasons" why the TTSTGAT strategy 
might be a highly limited jjrocedure for .deal ing' with 'the question. Try to 
writq,' three reasons in order of imporjtanc^ to you in the space* below/ 



1/ d 



/■ W/ieh ijovi oKd ^atuildd that youui ^dcuonp oAd clQjOA^and dontxun m^an^ng ^o^ 

yoa^ plicu>z tioiYi- to thz mxt page. " ' 

ERIC s ir 
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You may already have guessed that the auChor-of this workshop sees the 
TTSTGAT as a limited procedure. Teaching the subject and then formal ly 'giving 
a test samples student performance at only one point in time.. This method 
gives little or no information Regarding the skills which students may have 
acquired prior to the teaching activity. Thus, 1t\is very difficult; to 
attribute the student 'S; test pef^fontiance directly to the teaching^ac^i vi tj^,* 
That learning took place can only be inferred. The situation is akin^to an 
ancient forirdilel for making. mice. ^ 



?l(icz'6t/iaiO ahd 6ollzd clothing In a doAk 
cfi/inoA. Oj{ ihz bakn and tkdn obhdAvz thd 
6pot 6zvcA<it u?eefeA tatoA. , 



r 



Mice usually appeared mysteriously when this formula was followed; but.note, 

a careful search'of the barn ahead of time was not part of the plan. 

'J 

Returning to 'the -limttaitiqns of the TTSTGAT ho^^might we alter the^ 

TTSTGAT strategy to collect stronger evidence that we have engaged in a 

■ ■ ' • ' I 

productive teaching-learning activity? Please list your ideas b^low. 



1 . * . ■ 



3. 
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Whzn you axz 'i>(xta>ilzd thcut nfjJi Idexu mafee i>ZYb¥t to you 
ofL U you fiQjaJUUj can'<tUnk/o^ any. at tka point, txvin 

' - the. page. 




If you suggested among a^et* things that a test be given prior to the 
< V > - j 

teaching (an early search of tl^e barn fonmice^ s'p to speak), this author 

would agree wholeheartedly that your plart would be strengthened. Student 
performance would then b€&^$essed at two points in time/ like this: " 



Pkz" ^4 tniLctl on 



o 



Now the pre- and post-instruction observations can be compared. The word 
ob6QAvcuUon has been used here rather than the narrower term tut. 



i3 
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Noting that time alwlys elapses between pre- and post-instructlbnal obser- 
vations, try listing below two aspects of the TTSTGAT scheme that still 
limit its eff-ectiVeneis for gathering useful information. 



1 >. 



mtn you OM. i^aZuiitd iMith .yo,uA zU6np> oK even H you ittL itymizd, 
pluoAz turn tkt' poQt. ' '■' », - 
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The .author knows at ^least two ways in which this obs^ation design 

s ' > ' 

is limited. • 

- ' r - ^ * • ' ' 

1. Little inforiligf ion i§ gathered regarding events, other than the ^teaching 
activity, that are happlning to students between th^^re- and post- 
.instruction obseryatiatis . Yet human beings continually receive and process 
information outside the clasSrbom, by television, to cite on^ obvious ex- 
ample.' Thus, people ar^ constantly learning apart from the formal teaching 
activities provided to'them. ' This fact makes it difficult under the re- 

.vis-ed design to attribute differences -in pre- and post- instruction obser- 
vations to the formal teaching. Consider, for example, teaching readirtg 
for a year to a group of students who are regular Sesame Street buffs (or 
to viewers of another educational television progr^mf arid 'then trying to 
asses's the effectiveness of the school program. Under thiT plan, we 
- couldn't be very confident that our work alone helped them to re^d. 

2. The usefulness of ii\formation garnered from this design can^alsoj^e limited, 
by the students' natural maturation. A student's intellectual development 

might change recognizably for any number of reasons, including physiological 

^ ■ V 

development. That is, between the pre- and post- instruction observations, 

f I 

.processes functioning with time, such as growing older, hungrier, or more 
tired, can and do occur along with the teaching activity. It is therefore, 
difficult to attribute differences in ore- and post- ins.truction observa- 
tions to thej^ teaching activity itself. ^Maturation can be an especially 
big factor with younger children, as the books on' classification and 
conservation abilities in this series indicate. 
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■ Try to devise some strategies for modifying or adding to the existing 
ob$ervat;ional scheme to circumvent the two limitations described on the pre- 
ceding page. Don't forget your own ideas of the page before. that. 



r 



ERIC 



Tfiew coYvtinviz to tka mxt page,. 

16 



The. current plan can be strengthened consiilerably by observing a group 
of students who do' not participate in the teaching activity, we might set^^ ' 
up the following plan: - . . ^ - 



Group A 



P/ie - in6 tAuctio n 



TzaciUng ActLv^.if 



Group II 



{G^vzn at 6amz tmz 
to G/ioup6 I and 11, ! 



No TzachjJig^ kctivAjty 
^ \ OA. 



Vost-ijnl tAucticn- 

Ob6Q.Avatton 
(G-iucjt at 4ame timo. 
to GAoup6 I and IIJ 



Using this plan, yoi^ would be able to compare the performance of the group, 
of students who received the instruction to a group that, did not* If the 
performances se^n during the post-instruction observations ^re substantially 
different (or even the same) you will be better able to assess just how pro- 
ductive the teaching actiyity was. With this revised plan, you are able to 
make comparisons not only before and after your^ teaching, but also with an-' - 
other group, often called a control group, that did not receive instruction. 




A WORD OF CAUTION, however, ^ ^ C 3 
.A strong case must be made that Groups I aypd I Tare cbmparah^le 'in several 
xaysi(e.g. grade level, sex,. soci6-economic status, liO.) before you carry 
out the observations and teaching activities in this pTan, Otherwise, you 
may be working with two groups that are likely to react differently to the 



O teaching .activity, 
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An example ^oUdvo^ on thz mxt page. 
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We might wish to prp^e an experience of classifying plants in the 
out-of-doors^o our seventh-grade class.' The only comparison group avail- 
able is<an eighth-grade class in^anothep school.' On the pre-instruction 
observation both groups appear to demonstrate about the same classification 
ski-lls.. Yet there are a number of reasons why the two groups may not be , - 
equivajent In terms of their potential recepti veness to our instruction. 

Try to think of some of these reasoiss ^nd write them bel(pw. • 



2. 



Li. 





Agcuin, ijohzn you ofe -6a^(J>ced that youA Idzjxh 
hold m^flining ioK you, ptdoJ^a go on. 

■ 18 
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^ O <0 O'O^^ 

o ^ 
o o ^ 

<r ^ ♦ 




^ ■ \ • 

A NUMBER OF FACTORS may make. these- groups nonequi valent in how our teaching 
activity affects them. ' 

'4 * • 

REMEMBER, THIS IS A CRUCIAL POINT IN SELECTING THE' CONTROL OR COMPARISON 

V . ^ - 

GROUP. HAS IT BEEN DETERMINED TO THE BEST OF OUR RESOURCES THAT THE GROUPS 

Al^E EQUIVALENT WITH RESPECT. TO THE POTENTIAL EFFECT OF OUR TEACHING ' 

ACTIVITY? i ■■ ' , 

Here are some possible factors that might limit the equi valenc^of the 
seventh- and eighth-grade groups. in the example. 

1, Readineiss to learn advanced c1c)ssification skills goes with intellectual' 
development, at least according tg Piaget. . (See Learning About Learning: 
CI ass i|f i catj on AbiJ i t i es , in this series.) 'Thus, the seventh- and eighth- 
grade/groups may differ in how they deal intellectually with'the teaching 
activity.. * 

2, One 0^ >^he groups may be more accustomed to field trips in^the out-of-doors 
than the other group; the instructional setting and not just the activity 
per se could affect the post-instruction observation. 

3, The distributicm of sexes might differ \^'dely between t^ie two groups and 



affect the rate of learning. 



4. Attitude toward an out-of-doors activity may /dry widely, especially if 

« 

one group attends ^n urban and the other a subur"ban school, 

5. The atti tudest of the teachers of the two classes toward the activity may 
'>be quite different, affecting the climate of'learning in which the activity 

is approached. 
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IN PRACTICE, it is impossible to establish the exact equivalence of 
y ^the control group and the qroup that participates d^i the teaching activ- 
ity. However, the better the case- made for equivalence^ the better the 
chances the observational data will be useful .to you or other intereHed 
persons. . y • 




T/ici iJi pfwbabtg a good- place, to go tjue/t 6omt oi tltut Idzoi, 

with tfie UCCTP? \taU- *^^^. Pf^9^. ^ °- 

bcki^MJUid iom, oi the ob&eAvaXlon ptayu, di&cu6&&d -6o f,(UL. 




s 
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SUMMARY OF OBSERVATIONAL PLANS 



Teaching Activity 



Observation 



^ 



Comments - 
H^hZy limited. 

bdiavioA only 
once. No compa/i- 
i6on QKOiXp. 



Pre-instruction 
Observation 



Teaching 
Activity 



Past-instruction 
Observation 



' KUpZCt to pOtZYltAMZ 

activity 



Strong ptan 
than- 1 . StUl 
txciu compaxUon 
Qfwup., Good ion. 
looking cut inttnndt 
change , but can- 
not gjiJixViOitizc . 

■ I 



Group 1 



Group II 



Pre-instruction 
Observation 


-> 


Activity 


-> 


Post-instruction 
Observation 












Pre-instruction 
Observation 




No 

Activity 




Post-instruction 
Observation 




^ccorm^dcd ptan 
af^en possible. 
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UP TO THIS POINT; we have used the terms pn.z- 'and po6t'in&tAactlon 
ofa^eAvotconA to describe our efforts at data qatherirrq and record keeping 
before and after our teaching activity. Try now* to list a^ many ways 
as you can to obtain Observational records of. student activities. 



2. 



\ 5. 



6. 



When youA continazd ha^d thinlving ^ 
not producing any ^uA^e^ idzM (^on. 
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youi OAZ invited to tuAn thz page and 
compoAz youA. tUt voltk onz coYihtAacXtd 

by tki& auutho^. 



22 



HERE IS A LIST OF SOME POSSIBLE METHODS FOR MAKING OBSERVATIONAL RECORDS' 

\ 

\/ld^o Tdp€A, Audio Ta^ptM WAitt^n Tut6 

Clci66 Wonk \^ E44at/4 Log CaAdA 

Jntt^vlm^ Photoqnxiph^ - ^ d-SoAJtinq 

tAaMactional R^coAcU Acfftevemen^ Tuts 

^ Coun6£>Ung VaXa VoAant Rapon^ 
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> Each of these methods has its own special set of advantages and 

4 

disadvantages. THERE IS NO GENERAL RULE 'TO FOLLOW IN USING ANY SINGLE 
.METHOD. IN GENERAL, IT IS BEST Jo' USE SEVERAL, METHODS IN A GIVEN 
OBSERVATIONAL PROCEDURE SO THAT THEY MAY BE USED AS A CHECK AGAINST 
EACH OTHER. For instance, in the example of classifying plants in the- 
out-of-doors presented on page 13, a simple questionnaire atver^ to each 
class could Shed light on a!l but one of the limiting factors discuss,ed 
on pageMA«J 

^ ■ * ' 

(Which factor might not be very readily investigated 
by a questionnaire? 

See the factor' the author has identified, at the ' 
bottom of the next paqe.) 

The staff will be very happy to assist in deciding what kinds of obser- 
vations might have the greatest potential- for gathering productive 
information for you. 



When t/oa oaq, A^ady/go" on to th^ n^xt pagz. 
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Please read the following teacher's statement of a proposed educational 
research project. ' - . 



'^J voant to f^Jjid oat uJhzthzA., a^teA mg Irut/iuction, my 
6tud^yU&\h(lv^ gn,OiA)n In tkzlK appn.tcxatLon of^ Engt^h 
' titzKxuAz (or any other subject)/' 



V 



If you were this teacher, how would yoy proceed?. Write down some of your 
ict^as before stuclying the author's V^eactions, given on the next page. 





2^ 



'sai^LAL^oe qSnouM^ passasse :}saq au-e 
(aup uo;oei) SLLt^s uo.ueoiiLSseLO -sauLeuucL^sanb 
i|6noui|:^ passBSse aq p[noo sapn;L:;:;'G pui> *saxas 
uoL;rjqu;s|p *sdu; Vi^i^ ^'X^^ aouauadxa uoud 



What this teacher has expressed is fine as a starting point. However, 

m • 

in this 'statement we do not haye^a very tangible objective for research, 
which makes it difficult to proceed. You may 'have already iderrtified the 
difficulty of devising an observational method for documenting an abstract 




notion such as^ opp/ie creation. One suggestion is to try to formulate pre-' 
cisel^ What appreciation' of EnglishT^musfc, art-, a.cienc6, math, or ^ 
other subject might mean in 'terms of student behavi or. Far exaniple, ^ 
apmreciatiQA might be measured by observing (through any appropriate method 
list^dlon page 18) what things students chbose to work on when their titne 
is thMr own. If this suggestion is followed, you v^.ill NOTE THAT THE 
RESEARCH QUESTION HAS CHANGED IN A SIGNIFICANT WAY. y\t first, the question 



was sj^mething like this 

I 



\ 



K^tzfi my ^niit/niction, havd my 6tud^nt6 gnvtm in thuA 
^ appn.(LCA.cution . . . ? \ . ^ 

Therii it becomes more like this: / . 

K^toJi my iMtmiction, lailZ kif ^taddwU vohintaA^ly 6pznd 
mon,(L timz doing . . / ? - 

/ Though the first question may better express the original idea of this 
/(eacher, it remains vague in terms of actual student behavior arid is not 
'^easi ly researchable. The second question is researchable because one can 
/ observe the degree of voluntary behavior. But in this .case, one must 
accept the idea that volj^ary behavior is somehow an expression of 
appreciation. 

In the second question, an OPERATIONAL DEFINITION of appfKLclation has 

been written. OPERATIONAL (DEFINITIONS ARE DIFFERENT from the definitions 

found in dictionaries, which are called FORMAL DEFINITIONS. To Idoxn moH:z 

about tkd dLa>tincjtion^ boMjOQ^Q^n tko. two , tA,y thd q.X(IAcaj^q. on tht ndxZ two 

} 






O peration al definitions are 
constructe"? around a compar- 
ison (an operation) and, 
though narrowly applied to 
the situation at hand, they 
can be extremely useful in ^ 
their lack of ambiguity; 
indeed, they are intention- 
ally limiting. 



Example 1 . . • ^ 



Form al definitions are 
like those found in the 
dictionary anrf make use 
of analociies, similies, 
metaphors,, and so on. 
Formal definitions can » 
depend upon circular 
arguments and ambiguities,, 
leading to no useful 
frame of^ reference. 



Example 1, 

Oily meojtA (^vJil of on. 
containing oiZ. 



The table may look more like 
X what many people call orange 
but, if we accept the defin- 
• ition, we are obligated to . 
live with it and carry outl^ . 
tests for the color tjdlZow 
by comparing items in ques- 
tion to the table. 



Here the word oiZ is used 

in a circular fashion in 

the definition. ^ 



Example 2, 

Ol.tij mQAM thd voay my hand/^ 
my coA. 



Example 2, 

Vdllo^ meanA havinoi a 
yzlto^Aj^ii^^loK. 



Study the set of statenents on the next paqe and try to divide them 
into two rjroups: one containing operat-io nal arjd the other fsnnal 
ERJC definitions. 

7 * . 
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1. I.Q. is the scoreVtained'by a Stanford-BiffTTtest. 

2. Lenity is the qualityor state of beinq mild or qentle, as towards 
others.' - 

3. Yellow is the color of this table. ^ 

4. Teachinq is the act or profession^jf one who teaches. 

5. ,A larqe number means more than the size of the population of Berkeley. 

6. Meaninaful lea.rninq is when children can recall the names of all 
the U.S. capitols. 

7. Accordinq to Piaqet, coqnitive nrowth neans nassina thVouqh 
intellectual develoninent 

8. A scientist is an sxper^ in ^ci^nce, especially one of the physical 
or natural sciences. * 

9. In my opinion that is few. 

10. Scoff is an expression of mockery, derision, doubt, or scorn. 
^11. Retaw is a substance having the chemical formula H2tl^3v 

12. Oily means full of or contairrinq oil. 

13. Readinq achievement means tHe differential of scores obtained on 

the Cramer test. 

} 

* 14. A valuing question is one like, "How do you *fepl ^^bout that?" 

15. Payinq attention means directing vision'' towards the teacher. 

16. Newjcomer means a person who has recently arrived. 



V 

Wfien yoa oaz happy vjUH youJi tm gfioapi, compoAt thm Mltk 
thoi>z coMtAacjttd by the. aiuthoA on thz nzxt page.. 
■ Vl6ciu>6 dU^^^ncie^ , li any, wWi thz &taU' 
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Mo/ie -tifee opeJiationaZ dQ-f^nitioM 
.1, 3, 5, 6. 7. 9. 11. 13, 14, 15 



2, 4, 8,. 10, 12, 16 






For practice^ take the three statements on page 6 and us"e oper- 
atlonal dpfinitions to change them into questions that would be easier 
to use for research purposes. Write them here. 



1. 



3. 
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Wften tfoa it(Ll comf^oKtcxblt^ tkaZ you could mfik iauMi any 
and compoKz yoixk Id^ca^ uuJk tho6^ thz authoK. 
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STATEMENT I 

I Mould tikz to knouo hou; mufih mcuCh h^ ciny oth^K Aufaject) 

rl*vz taugkt my htudzntt^ . 

i 

OPERATIONAL FORM FOR STATEMENT !• 

WfiJtt voUZ be tha (it/(i$eAence^ in ^toK(U> on a SO-iXam (vUXhmztic 
tut admuiUt^nzd bz^ofiz and a^t^/i my in6t/iuction? 

ALTERNATIVE: How doe^ 6tiid^nt daily voonk^ in math compoAe, thAjOugh- 
- out tha yaoA vohzn tampl^d p^nlodi-colly ion. avid^nc^ oi gn^ovoth in 
pKob^^m-6otvinQ abiltity? 

^ — ■ 

''STATEMENT II 

I muld tik^ to knouj if^ homeM)oJXk {o/i any oth^K in6tAuctioruLt pjian) 
l6 u&^{ul ioA my taachlnq: , 

OPERATIONAL FORM FOR STATEMENT 1 1 

How dou thd quality oi mnk dona by my 6tudent6 in clxUh duAi^ng 
p^fiod& vohzn homeM)oAk i6 cJUo baing a66lgnZ(i compoAa uxith th^ 
qualLty oi mnk complztad whan thoAd ^ no kommonk nzqaiJijmwt? 

ALTERNATIVE: Hou) much tima do my 6tud(int^ 6pznd actualty t^onkjjig 
duAing po^Kiod^ ujhzn homwoAk l6 oAA-cgned, compoAzd i/uMi tho6Z 
peAA,od& ^^)h^n it iJ> not a66igne,d? 




STATEMENT III 

I voould tika to beXt^A und^Mtand my 6tud^nl&^ intzllzctual 
development (o/l some other dimension pertaining to the learner) 

A 

OPERATIONAL FORM FOR STATEMENT III 

How do my 6tude.nti> pzA^onm on the. Plagetian tcL6ki dUcAibed In the 
LeaAnlng about LeoAfUng booklets of, tJyU peJU>onal wonkshop 6efu,eJ>? 

ALTERNATIVE: How' do ta^ki and activltieJ, occuAAlng eveAij day In 
my cJUA&fioom indicate my students' intellectual development? 



IN SUMMARY, STATEMENTS THAT ARE OPERATIONALLY DEFINED GIVE A CLEARER TnDI- 
CATION OF HOW TO PROCEED WITH THE RESEARCH OR ASSESSMENT THAN DO STATEMENTS 
.THAT ARE NOT "OPERATIONALLY DEFINED. 

To' exomoie another liAue. in fieJ>taAch and aAi>eJ>&ment, pteoie tann the page. 
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Hoio can T del^-uie m^\6tud(j 6o that it l6 manaqzabtz in amount of^ 
' infidmation qathoAdd and it6 comptzxAXy? 

As already noted, the logos on page 4 is complex, n is obviously 
impossible to research everything at once, thus the need for specifying 
the limits of the study. ^^ 



Examine the following hypothetical assessment proposal: 

; 

} want to find out how cfiildren develop reading skills. 

List below ways In which you think this study as now Hpscribed could be 
further defined ih order to make it more manageable. 



fae tz(,taiy itoutzd, ptzcuo. go on to thz mxt paqe. 

A : 

30 
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One useful procedure for limiting a study is to list as many of its 

characteristics as possible with a yiew toward elimination and simplification, 

- ■ . ' ( 

The example on the last page was: 

I want to find out how children develop reading skills. 

Here are some possibilities for narrowing the study: 



1. Instead of speaking of "children" in the general sense, select a 

particular age ^ange. sex. socioeconomic background, ethnic grouping, 
school population, region, etc. 



2. Instead of all reading skills, -chopse a specific set, such as 
phonics, word association, .chaining, etc. 



3. Determine a ttme period for the study, rather than allowing it to go 
on indefinitely as implied in the above statement. 



4. Another possibility that you might think of at this point is: 



J\nJit, l& pfLobabty a good ptacz to 6top 
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Wkat kinds of. jldtd 6tudi(i6 ka\;z the g^^cUut potzntial {^,oK pKoda(bing OAzf^iil 



Take a minute to look , again at the themes represented in the logos' on page 4. 
In case you hfive not already recognized the correspondence, ttlfe three questions 
listed .at the beginning of this workshop on page 6, natch the themes of the 
learner, the discipline, ^and instruction. 

These themes e;orter into the context of all teacher-student interactions. 
The association of themes in an active classroom is usually complex, but this 
vpry complexity offers every teacher a laboratory that is rich in potential 
for productive field research. ^ 

At the same time, this complexity poses some hazards to obtaining useful 
information. There is SO MUCH to study that the PURPOSE and PLAN of the 
study becomes paramount; it is crucial for you to articulate the purpose 
and plan bpforehand in order to avoid utter confifeion. 



It. i$'4he author's eperience that the kinds of studies which most affect . 
a teacher's personal dev^glopment are those initiated by the teacher himself, 
dealing with his or her own special interest^. 



Think about the PURPOSE of the study first. Consider again the questTor>(s) 
which you presumably listed on page 5. ^ • 

Mom; tn.ij tUting on*piz mxt page youK Knjn^on (^on. vxinting iomz ani,MQMJ> to 



thoAe. qaz6tionA. 
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My ;*easons for wanting answers to my questions on page 5. 

■A 

• 



/ 



Now consider' very honestly whether your statements above actually reflect 
your personal interests. Tf^^hey do, your study has a very good chance of 
producing mean^'ngful information for you. As a result of this interest you 
will probably have the perseverance to see the study through. s, 



O Ag<un vohzn you oAZ &aJbUilzd mMi youA 6tcutvrzntA corvUnaa to thz nzxt pa^z 
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HoM can I mo6t cX^an^ii cormuyUcaXt mt/ rieJ^^oAch 



Study the following statement written by a^new graduate student in 
education. (1) List some dimensions of the statement that limit its 
effectiveness as a report of field observations made by student while 
working at Pin^ Hill School. (2) Then try* to rewrite it to strengthen 
i-ts meaning as a research report. * 

''HzAbvct Koki txp^^6td thz Pirn HUZ (LnviAoYmant In kJj^ book. 
TfieAe vo^A^ no oppontimLtioJs ion, ihz dUldAm to int^nact loltl^ 
th(uJi MvVLonme,nt. I ^ttt aon6tantly in conf^tict i^uMi the, poAo^U , 
voho had highly t^ndiXiGnal e,xpe.ct£uUon6 . Vzt tiie. chltdfian llkzdi^ 
me be.cau^t I undtutood hdi^) thty Itcinmd/' . ^ 



2. 
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When you are finished, compare your observations to 
the author's, listed on the followinq page. 

34 



/?////////// 



One limiting factor of the report is the number of words for whT.ch\ 
no OPERATIONAL DEFINITION is given, "ee previous discussion on pages\lR\- 24. 
For-example: 



^^undzutood hc^ thztj Iza/imd*' ; 



•1 




Most teachers have ideas concerning these notions, but the ideas can 
vary widely. By giying words an operational significance, the educational 
researcher can commuricate more precisely, and his report will have clearer 
meaning for him or other interested persons. 

>* 

The following is one possibility for strengthening the report. 
Compare it with the original, then discuss it with the staff and cor^plete 
the exercise on the following pace. 
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''HznhznX, Kohl dQji^cnAbzd thz Pirn Hill School enu'>^-;:rnenx 

In \fii6 book, TklA; ty-6lx Ckild^m (paqe4 34 - 35), I did not 

ofaAetui?. anif opponZunltyiiib fo^ tiiz dilld^zn to 6pznd tAjnz 

loltti mantpuijcuUvz cuAXiq,ulum matzAyLal6 , 6uch as ti\06Z dzvzlopzd 

at tilt lawn.zncz Hall o(^ Scizncz. T/ie pa/ient6^ goals ^^ok th(UA 

chAJid/izn we/te dif^z^znt ^^om mine. Tc/i zxamplz, in mathmatA.cs , 

thz pa^znts voantzd a vOAtttzn hom(Monk aS6tqnmznt f^^om me. zvzAy 

zvzning, vohz^zas T voantzd thz 6tadznts to 6pzci^tj mo^z o{^ thoAJi 
I 

oton Izanyung objZctAVZ6 . .1 had 6tadlzd tiiz tntzHzcttml 6tagz6 ^ 
0^ dzvzlof^znt 0^ mo6t o^ thz 6tadznts, using Plagztlan pMtocol6. 
J u6zd tht^ tn^oAmatton In planntng InStAuctional acttvittz6 
iMith thz 6tadzntA, and in mi^ opinton thzy tikzd me moKz a4 a 



tzachz^ i^oA doing 4o," 
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Continue to the next page. 



How are' the following notions operationally detained in the revised 
report? List your ideas y low. 



THOUGH THE REWRITTEN PARAGRAPH IS LONGER, IT IS ALSO MORE PRECISE. PERHAPS 
YOU CAN THINK OF WAYS TO STRENGTHEN IT FURTHER. LIKE ANY SKILL, PRECISE' 
WRITING TAKES PRACTICE AND CONSTANT FEEDBACK. READING SOME GOOD RESEARCH 
REPORTING CAN ALSO BE V^Y HELPFUL. We suggest that you do both. Get to- 
gether with the staff and plan to do some writing on which you can get some 
feedback. Also ask the staff for references to field studies or other 
research reporting that you can ;5tudy. If you would like to review basic 
rules of writing, you might enjoy reading The Elements of Style by William, 
Jr. and E. B. White (second edition), The Macmillan Company, 1972. 



YOU MAY WANT TO USE THE CHECKLIST ON THE FOLLOWING fAGE WHEN EXAMINING 
.CLARITY OF STYLE IN EITHER YOUR OWN OR OTHERS" WRIT/ING. t 



SOME SELF-CKECKSTOR CLARITY OF STYLE 



1. Have I used simple, concrete language; have I avoided jargon? 

2. Whenever possible, have I used the active voice (e,g. StadznU {^IJUidd 
oat th(L qm^tionnoAji^M) Td^ther than the passive voice (e.g. Tht\wi6' 
tionncuAz6 m^iz f^XXtdd oitt by 6tude.nt6)? 

3. Do my relative proinouns (e.g. It, thzij, hvi, lUm, thm and so on) an(( ^ 
subordinates clausels (introduced by i^ho, iA)hlch, that, lohat ^nd so on) \ 

, have clear and unajnbiguous references? (See example at bottom of oaqe,) 



4. Does, each paragraph contain one coherent set of ideas? 



5, Is the sequence of ^he paragraphs logical? 

i 

6, Is there a sense of joperational definition to my ideas? 



Mr 



7. Have I used specific examples in my report? 



8. What are facts and what are inferences in my writing? 



9,- Are any statements open to multiple interpretations? 



> ■ ■ . 

10. Does my writing portray an accurate picture of what I am tryijafl 
to report? " ^ 



V 

\ 
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"I had hopzd that nif 6tude.ntA coid.d do thQlfi Idamlm dXiodrtandntA 
with thz hamStdhA novo^, but the.if mXQ. a>slee.p.'' (See 3, above,) 



Ho'O can I onganLzz tkz- lASfiLtzap mu ciMzi^mznt HQJiZaA.ch'? 



.THE FOLLOWING IS ONE POSSIBLE OUTLINE FOR ORGANIZING THE FIELD STUDY RESEARCH 
REPORT. If formal reporting is desired. , 



A. Preliminaries 

1 . Ti tie Page 

2. Preface 

3. Table of Contents 

4. List of Illustrations * 

5. List of Tables or Data . ' » 



B. Text 

1 . Background to the Study 

2. Delineation of the Study 

3. Formative Evaluation (if any) 

4. Procedures of the Study 

5. Findings 

6. Concluding Discussion 



C. The Reference Matter 

1 . Appendix 

2. Bibliography 



On tkd ndxt pagz, ijoa lixitt {\^nd additlonaJ^. Inf^onmcution about Q.ach o/^ 
th^d zlzmznt& o{\ tho. n,(ipoht. [Voa matf not loant to 6tudi^ tlid ddtaltb oi all 
o{^ tixd, Q^lmzntA, but all oAe Ino^xidzd f^o^ complQX^nu^ . ] Study tlxo^o. zle- 

V 

mcnt6 that you (^zzl oaz vubtfiul. to you. 
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f'relim.inaries 



1. Title Page 



The title page contains the title of the study, the date, 
and the name of the author. 

2.. Preface' , . .■ . , . ' '- 

The preface contaip^ information about and acknowledgement of 
any special circuffistances or resources of the study, 

3, Table' of Contents 

The table of contents lists the title and beginning page num- 
hereof each section of the book, including lists of tables or 
illustrations, chapter^, subdivisions of chapters (if any), 
appendices, and bibliography. ^ 

.4. List of Illustrations ** ' 

\^ ' Jhis list shows the titles and page numbers o'f illustrations, 
including maps and graphs. 

5. List of Tables or Data - , - 

This list gives the titles and page numbers of tables or other 
displays of data. 



B. Text 



1 . background to the Study 

This section increases the meaning and usefulness of your research 
by placing it in a context. In stating the facts and-situations 
that led up to your study, vou are providing a rational for your 
particular research, ''ith a strong rationale, the study wilT be 
significant no matter the outcome. Though a researcher may carry 
out a study without, constructing a case for its significance, he 
or ^he is gambling that the outcome will be meaningful on its own 
terms. If the results are not interesting, the reader questions 
"W^it/ did ijou lnvz6tigaXe. that In ^/le {^lut place,?'' This author 
suggests that it is not necessary to gamble, since any of the 
statements on page 5 which opened this workshop, can lead to 
studies for which a strong rationale may be constructed. To ^ 
summarize this is the section in which to review the literature 
leading up to the study. 



erIc , ^: - . 
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Text iaontinazd) 

6 

2. Delineation of the Study ■ ' 

This is an important section of the research report, in which 
you define and state youf^ responsibilities as a researcher. 
Here you tell how you*ljmited the study so that it was manage- . 
able and had a foreseeable time limit (See pages 26 - 31). 

\. Formative Evaluation 

The formative evaluation describes all of the changes in origiaal 
research procedure and the reasons behind these changes (for 
I example, you might include the results of pilot studies and how 
these results Ted you to change your procedure). In order to be 
able to write this section, the researcher must, frofn the very 
beginning, keep good records of the evolving research project. 

r 

4. Procedures of the Study 

This is where the researcher reports in "specific detail how the 
study or research was carried out. (Cross= reference can be made 
to modifications made during the formative evaluation and des- 
cribed in 3, above.) 

5. Findings ^ ' 

The facts uncovered by the study are reported in this section. 
Only information supported by direct evidence is included here. 
Inferential' statements or subjective statements by the author 
do not -belong here, but in the concluding section. 

• 

6. Concluding Discussion \- ■ 

^ This section discusses the implications |0f the study for curric- 
ulum reform, increased understanding of the learner, modification 
of instruction, further research on any of these or other issues 
in education. A few subjective statements by the researcher are 
a possibility here, but only if they are clearly identified as such 



The Reference Matter 
1 . /\ppendix 

The appendix contains indirect but useful\,information for helping 
the reader understand the study. It is an appropriate place for 
samples of curriculum materials you may have- developed, examples 
of student work, tests, questionnaires, self-reports, or even for 
samples ^f many of the observational records listed on page 18. 
O^tm 60fm 0^ tivU In^oAMvtion but placed dAA2,ctty in one 
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C. The Reference Matter 



Bibl ioqraphy 



The bibliography contains references to all research and back- 
ground reading that you did while organi^jinq .the study and 
carrying it out. For one recommended style of bibl ioqranhical 
citations, see A Manual for Writers of Term Paners, Theses, 
and Dissertations by Kate L> Turabian, mentioned under "References 
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On t/ie fiOltoiainq mqe,, In conchiAion thAj^ m^h^hnp, . 
to bt u6^^ul to tjoa in f^o^muiatJ^nq a ^acc(>A6^id 6tad(f, 
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SOME SELF-CHECKS AND NOTES 
FOR COMPLETING A PRODUCTIVE ASSESSMENT PROJECT 

0|( thz 6'ta{^{i] duAlng th^ dzv^lopmznt and (LvahiatioY\^ti youA {^loXd. 



1. Have you identified a field study problem in researchable 
•(operational) form' and described it unambiguously in writing? 

2. Does the study have a foreseeable time period wi.th definite limits, 
and does it have a manageable sequence of operation? What are these? 

3. Have you considered several possibilities for gathering information? 
Explain your reasons fdr accepting the methods that you have decided 
to use, 

4. Have you identified, in advance of the study, potential results that 
would contain meaning for you or possibly someone else? What are these? 

«• 

5. Did your study go exactly as planned? Tell about this. Did you 
modify your plan (so-called formative evaluation)? If so, in what 
way(s)? ^ y 

6. Did your study reveal information that changed or confirmed your 
attitude of approaches toward teaching? If so, in what ways? 
Identify these with some degree of precision. 

?• -Does the writeup of-your study meet university graduate standards 
for organization, clarrity of style, rrrammar, and succinctness? 
Have you presented an unambiguous account of what you have accomplished 

8. Did your results confirm present pripctices or lead to any operational 
changes (no matter how modest) within your school cr other schools in 
the district? What are these? Do these results have the potential 
for confirming p^ractices or influencing instructional changes else- 
where? Explain* 

9. 'Do you believe that your' results are indeed related in some fashion 

to what you tried? Explain your reasons for your thinking on this. 

10. A self-check of my own, important to me: ^ 



11 
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APPENDIX * 



Learning about educational research and assessment - 
EVALUATION FEEDBACK TO JHE AUTHOR. 

Voa OAZ invltzd to KdcoKd LfouA Kzactioyu^ to tiiU booklet b^ou), and Kdmovz thd 
6h(izt\>and maiZ to^ ^ 

The University of California 
.CQoperative teacher PreparHion^ Project (UCCTPP) 
^. * , Lawrence Hall of^ Science 

Berkeley, California, '^4720 

\ . . ■ 

Upon ^^cZyipt youA^^valuatLon, yournarm vxiXl be placdd on otiA mditaig tUt, ' 

you icUh.to 'Kzctivz thz pKojdct mmleXtzK and pinounce/nen^ qthtn. 
pabZ>i(iatioYib . 



1. What things were you able to do after interacting with this booklet that 
you could not do. beforehand? 



2. 'hich sections (please list by page number and paragraph) were unclear for yo 



3. Which sections were the most useful? (please list page number and paragraph)' 



4. 'hat topics would you like to see expanded upon or added to the booklet? 



5. ^hat topics would you like to see deleted? 



Comnents: 



Thank you ioK youA KQJspon/>(L. 4:^ 



